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ABSTRACT 

This review of research literature about training in 
the skills of teaching indicates that change in skills can be brought 
about through different training methods, with different training 
populations, and in different training settings. This analysis of the 
literature was designed to assess the comparative contribution of a 
set of selected variables to gains in teaching skill. The variables 
were classified under three general categories: training variables, 
trainee variables, and setting variables. Of central interest in the 
review was the conceptual-observational instruction method of 
training. This instruction is based upon well-defined concepts that 
include the components of concept definition, exemplification, 
identification, and application. The favored medium was videotape or 
film. In over half of the studies reviewed, practice was provided in 
actually using the targeted skills of teaching. Feedback to the 
trainee on the use of the targeted skills was provided in almost all 
of the studies. The role of conceptual learning in the development of 
teaching skills is analyzed, and it is pointed out that training must 
result in understanding as a prerequisite to change in skill. It is 
also suggested that consistency of practice conditions is conducive 
to 'Optimal skill acquisition. (JD) 



* Reproductions supplied by EDRS are the best that can be made 

* from the original document o 



CJono^ual Variables as Predictors 
of Change in Teaching Skills 



David H. Gliessman 
Richard C. Pu^ 

Indiana University 



Paper presented at the annual meeting of the 
North Central Association 



Ch.icago 



April, 1989 



I nUCAtlONAi «f SOURCES INFOWMATION 



us DEPAHTMeNTOF EDUCATION 



• PERMISSION TO REPRODUCE THIS 
MATERlALj^AS BEEN GRANTED BY 



(* Mmnf < na"y»*S ^avt» r>OPr' ''MdC 'O miprnv** 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC) " 



2 



What we kno^, in tlie sense of research-based knovledge, about 
training in the skills of teaching can be summarized at a very 
general level. Vie know that teaching skills can be acquired or 
modified and that this is the case with a variety of. skills 
(Cniickshank and Metcalf , in press; Gliessman, 1981a) . Ohe research 
literature indicates that diange in skills can be brou^t about 
throu^ different training methods (for exaitple, modeling as well as 
microteaching) , with different training pqpulations (ine5$>erienced as 
well as esiperienoed teachers) and in different training settings 
(preservioe as well as inservice) . Ihere are, of course, limitations 
on our kncwledge as well. Most of the researdi has addressed 
relatively nonccnplex, generic skills (e.g. , asking hi(^er order 
questions or using praise and approval) assessed on a short-term 
basis (i.e., immediately follcwing training) using simple criteria, 
generally incidence or frequency of use (Gliessman, 1981b) . 

Granting these limitations, the trainer of teachers is justified 
in acting on the premise that teachinr^ skills are trainable. Beyond 
this general premise, however, the research preseiitly offers little 
help. What training oonponents are most closely tied to gains in 
skill? What are the optimal oonditicsTS of training? Are skills of 
differing oaiplexity differentially responsive to training? Ihese 
are a few questions concerning the variables of trainii>g about wiiich 
we knew far less. It can be argued that the development of training 
methods that are both optimally effective and efficient depends upon 
greater knowledge about the ef Ject of these and similai- variables on 
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change in teaching skills. 

Knowledge about the coiparative effects of different variables 
can be produced in two ways: b^' ocnparir*^ training methods, groups 
and settings within individued research studies or by ocnparing the 
effects of these variables across studies. With respect to the 
first, few researchers have conducted direct oonparisons of different 
training methods (or their ocnpc^ients) and very few have contrasted 
the effects of training in different settings or for different 
training groi^js. Ihe most substantial atternpts to contrast different 
training ocnponents have been in studies of microteaching; the 
ocnponents ccnpared have included audio versus video feedback and 
practice with peers versus practice v;ith school pi:$>ils. In a 
ccarprehensive early review of microteaching studies, Tumey, Clift, 
Dmkin and T^.'aill (1973) concluded that the studies reviewed reported 
generally inconsistent or conflicting evidence on the effects of such 
variations in training on skill acquisition. In our cwn review (that 
will provide the basis for the present paper) , we found that a total 
of thirty-six ccnparisons of training variables r^rted in fourteen 
stuiies yielded only two significant differences (Gliessman, Pugh, 
DcMden and Hutchins, 1988) . Our tentative conclusion, based upon 
these two sources, was that the variables ocnpared were perha^^ not 
well chosen in terms of their probable influence on teaching skill 
(thc^ variables included in our c^ review, for exairple, included 
e^ly versus delayed pretest and self-directed vei^sus instructor led 
training) . 

Ihe review by IXimey et sLL. is iirportant fran a methodological 
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viewpoint as well as for its evidence* While they used a traditional 
study-by-study analysis (as have Cruickshank and Metcalf , in press, 
in a current review of training studies) , iMm&y and his associates 
did attenpt to "collate" the findings from different studies under 
specific training categories. These categories included, for 
exanple, media used to nodel teaching skills, pipils used in practice 
and type of feedback provided. Sucii collating facilitated the 
construction of generalizations abatt the effectiveness of different 
media or forms of feedback. In a more ocnprehensive review, 
Gliessroan (1981a; 1981b} classified the training methods used in 
different studies as based xjipon cono^st learning, observational 
learning, practice and reinforcement and the ski] Is addressed as 
cognitive, affective, mixed and management. His conclusion was that 
the use of any of the four training methods, singly or in 
ccnibination, can result in guins or differences in any of the four 
skill areas. 

VJhat the Tumey et. al. and Gliessnian reviews lack, however, is 
a ccsnmon metric for measoiing gains or differences in skill 
acquisition across studies. Ihis introduces an element of judgment 
in ocnparing the effects of different training methods (or of some 
other training variable) that makes objective ocnparison extremely 
difficult. Ihis may help to aooount for the equivocal results that 
are so often xt^rted. To avoid this problem, we follc^/ed the lead 
of other researchers in using a meta-analytic measure called "effect 
size" as a ocsnraon metric. This made catparisons of training 
variables across studies a decidedly pore direct prcx^s. 



Variables Influencing Teadiina Skill . 

CXir neta-analysis of the research literature (Gliessman, et. 
al. , 1988) was designed to assess the ccnparative contribution of a 
set of Eselected variables to gains in teaching skill. The variables 
selected weorie classified under three general categories: training 
variables, trainee variables and setting variables. The specific 
variables included within each categoxy were: 

1. Training variables: 

a. General training method— training that included 
oonoqstual-observationsd instruction or training that 
incorporated cono^tual-observational instruction with 
practice. 

b. General training time — ^total time (in hours, days or 
weeks) over which training sessions occurred. 

c. Specific training tiim — time (in hours) specifically 
devoted to traimng. 

d. Amount of practice — ^number of practice sessions v^en 
practice was included in training. 

2. Trainee variables: 

a. Experiencje of trainees — iiie5^>erienoed or e^qserienced. 

b. Academic level of trainees — undergradioate or graduate. 

c. Certification level — elementary or secondary. 

3. Setting variables: 

a. Practice setting — university or college class or 
laboratory, laboratory within a school, school 
classroom. 

r. 



b. Fi$)ils taught ^en practice }tias included in training— 
elementary, secondary or peers. 

Because training method was of central interest in cur review, 
and will be of central interest in the present paper, the general 
methods of training ocaitrasted need to be described. Oonc^ual* 
observational instruction refers to instruction that is based i^n 
well- defined concepts that are instantiated in protocols, generally 
audiotaped or filmed. Ideally, such instruction includes the 
CGSorponents of conc^ definition, exeirplification, ideiicification and 
application. These ocnponents reflect seme well established 
principles of concept teaching (Clark, 1971; Stones, 1979; Tennyson 
and Bark, 1980) . Qhus, a skill such as using praise or approval is 
first defined, exanples of use of tlie skill are shc^, nsvf instancp^ 
are presented that require identification and finally original 
exanples are to be constructed by the trainee. Ihe anticipated 
outoane is sufficient grasp of the skill as a concept that actual use 
of the skill will follow or be increased. Ihis ooiiponent of training 
was included hi .all of the sttKiies that we reviewed althou^ perhaps 
never in its entirety; all studies, hcwever, included at least 
conc^ definitic^i and exeiiplification. Ihe favored medium was 
videotape or film althou^ audiotape and print i:>anetimes were used. 

In approximately two-thirds of the studies that we analyzed, 
practice was prxavided in actually using the targeted skills of 
teaching. One or more teaching sessions wens arranged for the 
trainee in a laboratory or classroom setting. In the laboratory 
setting, "pi5)ils" were generally classnates in a college or 
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university professional education course. When conducted in the 
schools, in either a snail group (i.e. , laboratory) setting or 
classroGRi setting, the pi^>ils were "real" perils at the elementary or 
secondary level. Feedback to the trainee on his or her use of the 
targeted skills vas provided in almost all studies that used 
practice. 

For xhe purposes of the reviet^, it was decided not to address a 
broad array of skills but rather to focus on a representative griieric 
skill so that the influence of the variables would be unaffected by 
differential responsiveness of cfifferent skills to teaching (the 
question of differential responsiveness mi^t well be an Infonnative 
subject for a further stuJy) . Ihe selection of a specific skill was 
relatively easy because the great majority of training studies 
address one of two sets of skills: questioning and indirect teaching 
style. <^estioning was selected because it is a cognitive/verbal 
skill that was judged to be c^imally responsive to training. 
Furthermore, it is a cosmnon conponent of training packages and 
programs that have been used in teacher education. Specifically, the 
selection of questioning as a skill translated into cisking hi^er 
order questions and asking probing questions foliiowed less frequently 
by analytical questioning and similar skills. Ohc coranon thread 
throu^ all questioning skills was that the trainee had to acquire a 
questioning category sudi as hi^jer order, probing or analytical. 

The criterion for skill acquisition in the studies reviewed was 
almost uniformly some measure of frequency of use. Quality of 
questions was very seldom used as a criterion. Assessment of skill 



acquisition was uniformly on an immediate basis (i.e., iimnediately 
following txaiidng) . Assessafnent was always conducted, of course, in 
an actual teaching setting vAiether university laboratory, laboratory 
within a school or school classrxxm. 

What did we learn fran this review? Me found, first, that 
edthough training resulted in significant gains (i.e. , the effect 
size was significantly different fron zero) in questioniiig skills all 
but one of the variables identified were unrelated to the magnitude 
of the gains. That is, no single training or t-rainee variable, and 
only one setting variable, was associated with the differexKse between 
training and control groups. Different amounts of training and 
different training settings did not affect skill gains while 
different teacher gra?)s profited equally from training, ihe single 
variable related to gains or differences in skill was concerned with 
pL5>ils taui^t during practice: trainees who tau^t peers wade 
significantly smaller gains than those v^o tauc^t secondary level 
students. In spite of this single result, hcwever, the differential 
influence of the variables on skill acquisition was-, inconsequential. 

When we considered the interactions between variables a scsnevSiat 
different picture emerged. There was evidence, first, of an 
int£a:action within a^tting variables. It was clear that 
inconsistency across p.':actice setting and criterion teaching setting 
(i.e., teaching setting in v^ch questioning skill was assessed 
follcwing training) affected negatively gains in questioning skill. 
Similarly, inconsistency between the certification level (elementary 
or seooncaary) of che trainee and pupils used in practice affected 



skill negatively. One '>woxst scenario" case would be a trainee 
studying to obtain an elemantaiy certificate who was asked to teach 
seoondaiy level students in a school classnxxn setting and whose 
skill was then assessed while teaching class peers in a univat'sity 
laboratory settir '. Secondly, there was evidencas tliat inG55)erienced 
teacher trainees profited significantly xtore from 
conc^jtual/observational instructic»i alone than did e}q?erienced 
teacher trainees. On the other hand, the two groi^js did not differ 
v^en training included practice. 

What do these findings suggest? Ohey suggest that consistency 
of practice conditions— in teaching certification, TOils tau^t aixi 
physical setting — is conducive to cfjtiinal skill acquisition. It is 
lil^ly that inconsistency in these conditions inhibits or confuses 
the demonstration of skills. Ihe findings surest also that 
ine>5)erienced traiiiees are likely to benefit xdotq tiian do es^xarienced 
teaciiers frcm conceptual-observational instruction without the use of 
acocstpanying practice. TSie greatest "pay off" in the training of 
ine^qDerienced trainees would appear to result from an €3T¥)hasis on 
leamir>g the meanincf —d af inltional and applicational— of the teaching 
skill that is to be acquired. It may be, of course, that our 
findings are limited by the fact that we were attending to a 
relatively noncxanplex skill assessed in terms of simple criteria on 
an inroediate basis. Certain of the variables considered—especially 
the training variables associateri with the provision of practice and 
with time devoted to training— mi^t have emerged as significant 
variables if a more ccnpleK skill assessed on a vx^rQ ccarplex 
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critarion had been the target of training. 

There is an added izcplication of these results, hcMsvei', that is 
cAiggested by the major finding that training itself clearly produced 
significant gains in gue&>tioning skill. It should be noted aga.1ji 
that cono^Jtual-observatioral instruction was included in all of the 
training methods both witl} and without aoocnpanying practice. Ihis 
suggests the hypothesis that it is the oonc^jtual dimension of 
training tliat is the central oonponent in skill acquisition. If 
practice per se were central to skill develqpsnent (as it is 
conventionally assuned to be in teacher education) then its 
exclusion from training in one-third of the studies reviewed should 
have resulted in a diioinished effect of training. Furtherroore, 
repetition or rehearsal or trial performance is so well established 
as a condition of skill acquisition, at least in the perceptual or 
psydhorootor realm (Garry and Kingsley, 1970; Stones, 1979) , that one 
would expect an increase in nuinber of practice sessions to ba 
similarly associated with an increased use of the practiced skills. 
In fact, in the studies reviewed, number of practice sessions was 
unassociated with level of skill acquisition. 
Ooncaptual LeamiiKr as a Central Variable in the Development of 
Teaching Skills . 

The view that conceptual leciming is at the heart of aoquirii->g 
teaching skills is ryot a new one. Wagner (1973) and Hargie and 
Maidment (1978) have hypothesized that the proce^ of acquiring 
teachjjig skills can be viewed, from a psychological perspective, as a 
process of acquiring those skills as discriminable concepts. In 
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brief, both view skill aoquisition as a particuldr cose of concept 
discrimination learning. W-igner's evidence shewed that the skills 
associated with direct and indirect teadiing style were modified 
significantly throu^ instruction directed at discriminating these 
skills as concepts. KacLeod and Mslntyre (1977) cdong with Griffith's 
(1977) have t^ken a somewhat different perspective hypothesizing that 
cognitive changes acoonpany esqperieiioe in teaching; these cognitive 
ctianges, in turn, influence the demonstration of teaching skills. 
Ohus, concepts are en^rgent in teaching, mediating skills as both are 
shaped and reshaped. A teacher may, for exaiiple, "sharpen" her use 
of analytic questioiis as she becomes aware of limitations in those 
she has just asked. 

We have, in past writing, attenpted to integrate these two 
perspectives by describing skill development in teaching in teims 
both of concept acquisition and concept formation (Gliessman and 
Pu^, 1987) . When the trainer is concerned with previously 
identified skills that cari be defined and exenplified, he is 
justified in treat iix; them as conc^ts to be acqjuired. In conti-ast, 
some skills result frxam probi solving by tlie trainee; for exanpla, 
he iki^t sense a need to involve students more eveiily in a class 
discussion. To meet this need, the trainee mi^t formulate a 
strategy to respond to signs of interest that occur prior to (or 
instead of) hand wav.ii^ or other signalling on the part of the 
students. The cognitive activity involved in this kind of skill 
develofxnent mi^t better be viewed as a task in concept formation 
because the skl.11 has to be conceptualized fran identifying its need 
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to defining emd dal.iiaitljig it. \te were able to provide direct 
evidence that tho use of either of these ^Xill developnent processes 
was effective as a ixaining strategy. 

Further evidenoe on the role of conoeptual lp::u.-ninef in skill 
development . Ihe scst definitive evidence on the role of conceptual 
learning in the develcpcnent of teaching sidlls CGmes frcnt studies in 
vMch each of these variables is measured. With a measure of gains 
or differe^Y^es in both variable, one is in a position to answer 
three questions: (1) Are gains or differences in oono^jtual learning 
acccsoipjnied by gains or differences in skill acquisition? (2) Are 
mean gain or difference scores in oonc^]tual learning and skill 
acquisition correlated? (3) Are the conc^ scores and skill scores 
of individual trainees correlated? These three questions, in order, 
reflect progressively more critical tests of the relationship between 
oonc^jtual learning and skill acquisition. To demonstrate a positive 
correlation between individual conceit and skill scores clearly is 
more convincing as evidence of the above relationship than to 
demonstrate that gains in mean concert: scores are acccnpanied by 
gains in mean skill scores. 

In the remainder of this section, will consider evidence on 
each of these three questions. It should be understood that the 
evidence provided is concerned with skill developnent within a 
conceit acquisition or discrimination model only; similar evidence is 
not available for skill developnent within a conc^± formation model. 
Thus, our findings are limited in scope if not in consistency. With 
respect to the first question above, ws conducted a selective review 
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of studies of diange in teaching skill several years ago (Gliessman 
and Puc^, 1981) . Olie five studi.es that we selected wexe th 3se in 
which (1) both nean carxxspt acquisition and skill acquisition scores 
were r^rted and (2) the training methods were essentially 
oonc^jtual-observational in design. Ihe teaching skills addressed in 
these studies were varied including questioning, infonning, accepting 
and student-centered teaching style. 

Since the detailed results of these studies have been reported 
else^ere, we will here describe those results at a general level. 
To quote frcan our original paper, "Ihe results of these studies 
uniformly show significant effects on skill acquisition follcwing 
conceptually-based. . .training. In all cases, post training skill 
scores were significantly greater than those achieved by control 
groi:?>s. ... In approximately half of the ocnparisons [between 
e>5)erijiental and control groups] significant differences [in concept 
scores] were fouixi all favoring the e35>erimental gratis." (p. 15) 
Ihus, conceptual-observational training unifomly produced 
significant differences in the teaching skills addressed vMle these 
differences were associated with at least one significant difference 
in concept scores in every study (four of the five studies reported 
ocnparisons on three different types of conc^t score v*iile the 
remaining stuc^ r^xDrted one) . 

To study the second question, "Are mean gains or differeiTce 
scores in cono^itual learning and skill acquisition correlated? ' , we 
conducted a search of the ERIC RlE and CUE databases for the period 
of 1/66 to 12/88 and carried out a new analysis of the final database 

ERIC 



from our previously parted study (Gliessman, et. ad.., 1988). This 
new seaxx:h and new analysis identified studies in vMch both mean 
csoncsqpit learning scores and mean skill acquisition scores werei 
r^rted. Ihe new search used eight conibinations of seardi 
descriptors that had been suggested by the descriptors f rosn the 
previous analysis, descriptors fran relevant articles, and a judgrnent 
frcm a review of the eric Ih^urus of Descriiators . Ohe ei^t 
ccTiTbinations of search descriptors were perfonnance and teacher 
education programs, performance and protocol iraterials. ijerformance 
and teaching? experience, teadier behavior and protocol iraterial s, 
p rotocol materials and behavior, protocol materials and laboratory 
trainincf. protocol materials and microteadiing. and protocol 
materials and teacher behavior . 

A total of twelve studies was found in which both nean concept 
learning scores and mean skill acquisition scores were reported. Ihe 
search of the ERIC database found nine studies and the new analysis 
of our previous database produced three studies, ihese twelve 
studies provided sufficient information to allow an estimated effect 
size to be ocnputed for both a concept learning score and a skill 
acquisition score (the resulting effect sizes are r^rted by study 
in Table 1 attached) . The judgment was made that an effect size, 
which is the mean difference between an esqerimental grtx^ and a 
control group divided by the pooled standard deviation of the two 
groi:^, reflected gains or difference for the two variables. Next, 
these two effect size estimates were then adjusted for small saitple 
bias (Hedges and Olkin, 1985) . Finally, the relationship between 
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these two variables was investigated using a Pearson product-nonrant 
correlation coefficient. 

The relationship between the ocxvosgit learning and skill 
acquisition scores as reflected in effect size estimates was found to 
be statistically significant. A correlation coefficient of .55 (df 
10, p < .05, directional) was found bet^«reen the effect size of 
conc^3t learning scores and the effect size of skill acquisition 
scores across the twelve studies, lhat is, a significant and 
positive relationship was found between the variables of conceptual 
learning and skill acquisition. 

Evidence relating to the third question, "Are the concept scores 
and skill scores of individual ti-ainees correlated?", was found in 
three studies and has been previously r^)orted (Gliessman and Pugh, 
1987) . Gliessman, Pu^, and Bielat (1979) , Biederman (1980) , and 
Kbran and Koran (1973) all r^rted correlation coefficients between 
concept scores and skill scores of individuals. A previously 
reported analysis of these three situdies revealed a weighted average 
correlation coefficient between the ccanospt scores and skill scores 
of .46 was found to be significantly greater than zero (p < 

.01) . A positive relationship was evident between the two variables 
based on scores from individual trainees. 
A Perspective on Training . 

In the context of training teachers, what ri«eaning does the above 
set of findings have? To -jegin, all three subsets (i.e., change in 
skills generally associated with gains or differences in concept 
acquisition, a po^iitive correlation between inean con^pt scores and 
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iiean skill scores, a positive correlation between individual concept 
scores and skill scores) are c.\t least consistent with the hypothesis 
that cono^tual leeiming is instrumental to the acquisition of 
teaching skills, lhat hypothesis is strengthened by another 
observation: To the best of our knc^ledge, oonc^t learning (as 
evidenced in conc^ acquisition scores) is the onlv variable that 
has been shewn to correlate directly with the use of specified skills 
in teadung (as evidenced by frequency of use) . In our own review, 
it will be recalled, no othPr training, trainee or setting variable 
was associated significantly and directly with skill acquisition. 

The conc^jtual variable entered, too, into one of the two 
interactions between variables that we found to be associated with 
change in teaching skill. Inesqjeriencec'. teachers, it may be 
recalled, profited significantly more fron oonceptual/c^sservational 
jjTstruction in the absence of practice than did es^jerienced teachers. 
We have reasoned that the former grotp probably had less initial 
fainiliarity with the questioning sskills involved and th\is had more to 
gain from instruction. But why did they apparently profit less from 
cono^>tual/observationsLL instruction when it was conjoined with 
practice? It is possible that tiie instructional ccnponent was too 
al:A)rcviated, less effectively done or not well integrated with the 
practice component in the case of these studies. In any one of these 
events, the net effect mi^t well be the same: a less than cptimal 
oonc^jtual base for effective practice. This interpretation is 
supported by two well designed studies that have experimentally 
manipulated the practice variable in skill ti-aining. Wagner, in her 
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1973 Study, fourd that essentially uninstziic±ed practice alone led to 
no diange in the teaching style skills that she addreissed 
successfully through oono^Jtual instniction. In a recent study, in 
contrast, KLinzing, K!.inzing-Eurich and Floden (1989) faind that a 
practice ocnponent carefully integrated with conc^itual instruction 
resulted in significantly greater use of skills in two of three skill 
areas (clarity and non-veriDal expressiveness but not interest) than 
did the same treatment in the absence of practice. Ihus, practice 
a^ppears to be effective when it is well integrated with a strong 
conc^tual ccnponent. 

To put the perspective that we have developed in this paper in 
other terros, our contention has been that training inust result in 
undarstandina as a prerequisite for change in skill. Biis is the 
kind of statement, however, that is easily enfeebled by taking it too 
generally. \Je mean understanding in a more precise sense: 
understanding a teaching skill as a definable, identifiable, 
aj^licable conc^ or category of behavior. Ohat understanding may 
be developed in two and perhaps more ways: throu^ the analysis of 
instances or exenplars of teaching skills, through trial use of those 
skills with evaluative feedback, or through both of these methods 
together. In any case, the most iitportant outccroe of training is 
conceptual even though change in skill is what we ultimately want to 
achieve. To leave the teacher without conc^Jtualization or 
understanding is to leave him trained , perhaps, but not skilful . 
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